Enhanced organization and retrieval of digital images

ABSTRACT

A system for organizing and retrieving digital photographs using global positioning system coordinates, comprising a digital camera  2  having a positioning system receiver for capturing a digital image, a first database  21  storing the digital image data along with positioning system coordinates of the location where the image was taken, a second database  22  for storing positioning system coordinate information and associated location names of a plurality of locations; and a processor  25  for determining the positioning system coordinates of the digital image stored in the first database  21,  searching the second database  22  for matching positioning system coordinates, and if a match is found storing the location name with the digital image data in the first database  21.

The invention relates generally to enhanced organization and retrievalof digital images, and more particularly to enhanced organization andretrieval of digital photographs using global positioning systemcoordinates, date stamp, and/or time stamp.

The global positioning system (GPS) has long been utilized to determinea position of a person or object. The GPS has been incorporated intomany commercial electronics, including portable telephones,wristwatches, and the like. Recently, GPS cameras have been introducedinto the market. These digital cameras contain a GPS receiver thatcoordinate-stamps each digital photograph with the exact GPS coordinatesof the global position where the picture was taken.

FIG. 1. is a diagram of a conventional GPS camera system. Shown in FIG.1 are GPS system 1, GPS camera 2, a representation of digital image dataand GPS coordinate information 3, and PC (Personal Computer) 4. Digitalcamera 2 receives GPS coordinates from GPS system 1, and upon taking aphotograph, GPS camera stores the digital image data along with the GPScoordinates of the GPS camera 2 at the time the image is taken. At alater time the user can download the image data and GPS coordinateinformation 3 into PC 4 for storage and viewing. In addition, when adigital image is taken, even in a non-GPS camera, a date and time stampis also stored with the digital image data.

The GPS coordinates that are associated with a digital image are beingwidely used to enhance the experience while viewing and managing theimages. U.S. Pat. No. 6,437,797 describes a system that utilizes the GPSdata associated with an image to superimpose a thumbnail of the image ona map image to enable the viewer to see where the image was taken. U.S.Pub. No. 2001/0022621 discloses a camera and cellular telephone systemthat stamps a digital image with GPS coordinate location information andcurrent-user data. Also of interest is JP Pub. No. 09-027937 thatdiscloses an apparatus that records a location name or address of animage having associated GPS data by searching a database containinglocation name and address information associated with GPS coordinates,and associates the location name or address with the image based on theGPS data. Also, U.S. Pat. No. discloses an information retrieval systemthat stores in a database position data (longitude and latitude)associated with a URL Universal Resource Locator) of a home page in aWWW (World Wide Web) server. When a user selects an image withassociated GPS data, the system searches the database for GPS data at ornear the GPS data of the image, and opens the home page associatedtherewith.

Although, each of these systems enhances the experience while viewingand managing digital images, there are several shortcomings of thecurrent advancements that leave the user still wanting. Although theprior art systems can provide a digital image with a date and timestamp, a user cannot determine if that date and time coincides with adate and time special to the user. Also, the searching and sharing ofdigital images from a particular location raises confusion when using aGPS coordinate system.

There is a need to have a digital image retrieval and management systemfor organizing and retrieving digital photographs using globalpositioning system (GPS) coordinates, comprising a digital camera havinga GPS receiver for capturing a digital image, a first database storingthe digital image data along with GPS coordinates of the location wherethe image was taken, a second database for storing GPS coordinateinformation and associated location names of a plurality of locations;and a processor for determining the GPS coordinates of the digital imagestored in the first database, searching the second database for matchingGPS coordinates, and if a match is found storing the location name withthe digital image data in the first database.

Accordingly, there is also a need for a method for organizing andretrieving digital photographs using global positioning system (GPS)coordinates, comprising capturing a digital image and storing thedigital image data along with GPS coordinates of the location where theimage was taken, storing GPS coordinate information and associatedlocation names of a plurality of locations; and determining the GPScoordinates of the digital image, searching the first database formatching GPS coordinates, and if a match is found storing the locationname with the digital image data.

In another aspect the second database is located at a location remotefrom the first database.

Yet in another aspect, the Internet connects the first and seconddatabases.

It is yet another aspect of the present invention to provide a systemfor searching digital image databases based on a GPS coordinate and dateand time stamp.

These and other features of the present invention will be apparent tothose skilled in the art from the following detailed description, takentogether with the accompanying drawings, in which like referencenumerals refer to like parts.

FIG. 1. is a diagram of a conventional GPS camera system.

FIG. 2 is a diagram illustrating a digital image retrieval andmanagement system according to an embodiment of the present invention.

FIG. 3 is a diagram illustrating a digital image retrieval andmanagement system according to another embodiment of the presentinvention.

A preferred embodiment of the present invention will be described hereinbelow with reference to the accompanying drawings. In the followingdescription, well-known functions or constructions are not described indetail since they would obscure the invention in unnecessary detail.

FIG. 2 is a diagram illustrating a digital image retrieval andmanagement system according to an embodiment of the present invention.Shown in FIG. 2 are digital image data and GPS coordinate information 3,and PC 20. PC 20 is not limited to a personal computer, and can includea web server, personal digital assistant, or other data storage anddisplay system. Contained in PC 20 are digital image data and GPScoordinate information database 21, GPS/location name database 22,date/occasion database 23, and processor 25. Also shown is input device27, which can be, but is not limited to, a keyboard, touch screen orother input device.

The digital image data and GPS coordinate information 3 is input fromthe GPS camera (not shown) to PC 20, and in particular into processor25. Processor 25 then stores the digital image data and GPS coordinateinformation 3 in digital image data and GPS coordinate informationdatabase 21. GPS/location name database 22 stores GPS coordinates ofknown locations associated with location name information of thelocations. For example, the Eiffel Tower in Paris has the followingcoordinates: latitude N 48° 51′ 32″ and longitude E 002° 17′ 35″.GPS/location name database 22 would store the location name “EiffelTower” and its GPS coordinates “48.51.32.002.17.35”. Of course, theformat of the information stored can vary with system requirements. Whena digital image and GPS coordinates are stored in digital image data andGPS coordinate information database 21, processor searches GPS/locationname database 22 for a matching GPS coordinate of a stored location. Soin the above example, if a digital image of the Eiffel Tower is taken,the digital image data and GPS coordinates where the photograph wastaken are stored in digital image data and GPS coordinate informationdatabase 21. Processor 25 would than begin a search of GPS/location namedatabase 22 for matching GPS coordinates. Upon finding the match of N48° 51′ 32″ and E 002° 17′ 35″, processor 25 would store the label“Eiffel Tower” along with the digital image data in digital image dataand GPS coordinate information database 21.

The search parameters of processor 25 can be adjusted to widen or narrowa search. For example, if the GPS coordinates of the Eiffel Tower areused as the search coordinates, processor 25 could be programmed to notonly provide the location name “Eiffel Tower” for association with thedigital image data, but could be programmed to also provide the label“Paris” as an alternative location name. Both location names could bestored or the user could be given an option of which location name toselect using input device 27. And, if a user desires to narrow a search,the system is instructed to retrieve a location label of an exact ornear matching GPS coordinates. So, for example, is a user takes adigital image while in his backyard, processor 25 conducts a narrowsearch an retrieves a particular street address associates with the GPScoordinates of the digital image, rather than a village name or nearbytourist attraction location name. Similarly, if a matching GPScoordinate is not found by processor 25 while searching GPS/locationname database 22, processor 25 can be programmed to find a nearest orseveral near matching GPS coordinates, and allow the user to selectusing input device 27 which location name or names to store with thedigital image data. Also, a user could be allowed to edit the storedlocation names using input device 27 as well as input and store GPScoordinate information and location names for locations not inGPS/location name database 22 using input device 27.

Also shown in FIG. 2 is the date/occasion database 23. Standardinformation recorded by a digital camera, with or without a GPSreceiver, is the date and time at which the photograph is taken. Ofcourse, a more accurate date and time would be available with a GPScamera, as the correct date and time is available from the GPS system.In either case, the data and time information is stored as part of thedigital image data from the digital camera in the digital image data andGPS coordinate information database 22.

Date/occasion database 23 stores known dates associated with specificoccasions occurring on the dates. For example, Christmas occurs onDecember 25 of each year. Date/occasion database 23 would store the date“12.25” and its occasion “Christmas”. Again, the format of theinformation stored can vary with system requirements. When a digitalimage containing the date a photograph was taken is stored in digitalimage data and GPS coordinate information database 21, processorsearches date/occasion database 23 for a matching date of a storedoccasion. So, in our example, if a digital image is taken on December25^(th), the digital image date, of when the photograph was taken isstored in digital image data and GPS coordinate information database 21.Processor 25 would than begin a search of date/occasion database 23 fora matching date. Upon finding the match of “12.25”, or a similar format,processor 25 would store the occasion label “Christmas” along with thedigital image data in digital image data and GPS coordinate informationdatabase 21. Processor 25 can be programmed to also store the year ofthe occasion along with the occasion name, e.g. “Christmas 2003”. If amatching date is not found by processor 25 while searching date/occasiondatabase 23, processor 25 can be programmed to allow the user to enter adate and occasion using input device 27, upon which processor 25 wouldstore the entered location label with the digital image data.Additionally, the search performed by processor 25 can be programmed tofind on or about dates. This will provide the user with, for example,the occasion “Christmas” even though the photograph was taken onDecember 24^(th) or December 26^(th). Also, a user could be allowed toedit the stored dates and occasions using input device 27 as well asinput personalized dates and occasions not already stored indate/occasion database 23 using input device 27. For example, a usermight input “Richard's birthday” and “June 2” as a user specificoccasion and date. Processor 25 would store “Richard's birthday” and“06.02” in date/occasion database 23 for later reference. Oradditionally, a birth year or year of a wedding can be stored, and thenprocessor 25 can be programmed to store the year of the occasion or asimilar label along with the occasion name, e.g. “Richard's birthday2003”, or calculate a particular number from the stored year, e.g.“Richard's 30^(th) birthday”.

In the above outlines embodiments, additional functions can now beprovided to the user to facilitate the digital image viewing andmanagement experience. Now that location name label and occasion labelhave been stored with each digital image data, the system can beprogrammed to search on the new label. For example, a user could desireto retrieve all of the images of Christmas from all years past. In thepast, a search would first have to be made using the date parameter of“12/25”, then search date parameters that are close, e.g. “12/24” and“12/26”. Finally, each photo would have to be previewed in order todetermine if they are actually of a Christmas related occasion. With thepresent invention, only one search would be conducted to retrieve all ofthe Christmas images, and without the need to preview each image, aseach image has been stored with an occasion label. Similar searches canbe conducted with the location name label also.

FIG. 3 is a diagram illustrating a digital image retrieval andmanagement system according to another embodiment of the presentinvention. Shown in FIG. 3 are PC 20, Internet 30, and computers 31-33.Computers 31-33 can be other personal computers, Internet web servers,or other computers with Internet access. In this embodiment, each of thecomputers 31-33 and PC 20 each store digital image data and GPScoordinate information on their respective systems. Currently there aremany web sites that cater to amateur and professional photographers.Many of these sites allow a user to upload digital image data onto theirweb servers for sharing and viewing by others. The present inventionwill facilitate sharing and viewing of images. A first user can uploador share his digital image data to one of computers 3 1-33. The digitalimage data would also include at least one of the location name labeland occasion label. When a second user conducts a search based on aparticular label, the system would retrieve all of the photographs withthe same or similar labels. For example, the second user might conduct asearch of “Eiffel Tower”, desiring to view other images of the EiffelTower. The system would retrieve all of the images with the “EiffelTower” location name label. A similar search can be conducted using theoccasion label.

Although the present invention has been described thus far in termsrelating to digital images, the present invention can also be applied toother image formats. The digital image data disclosed herein includesimages taken with a digital camera, a digital video system, a “web cam”(web camera), image scanner, or other device designed to capture animage or sequence of images in a digital format. And although the term“digital camera” or “Digital image data” is used herein for simplicitypurposes, all digital image capturing devices and digital image formatsare contemplated.

Further the system can use the time and location information for eachdigital image to group particular sets of photos for the user (e.g. in aphoto album or folder). This can provide the user with a meaningful namefor the set of images using the time and place information. For example,images taken in Paris during a period of a few consecutive days can begrouped together in an album. The system analyzes the positioncoordinates and dates of the images, and if matches are found, groupingscan be made, the system suggests or assigns, depending on theprogramming, an appropriate name to the album, such as “Paris—May 2003”,“weekend in Paris”, “Christmas in Paris”. When searching and grouping inthis manner, the system is instructed to broaden its search parametersto encompass wider geographical areas and/or date ranges. Of course, theadjustment to the search parameters can be user controlled to narrow orwiden the search and allow the user to accurately define the groups.

Another embodiment of the present invention relates to combining a GPScoordinate search with a data and time stamp search. Becoming morecommonplace in society are web cams positioned at stationary locationsthroughout the world. A user can access the real-time images captured bythese web cam via the Internet and view real-time video streams. So forexample, there might be a web cam positioned and directed at the EiffelTower, and a user can access the images captured by the web cam and viewthe images on his home computer. Or, as commonly practiced in amusementparks, a still image is often taken of passengers while on a particularride. Both of these formats can be archived, along with GPS coordinatesand a date/time stamp. As stated above, the date and time an image istaken is typically stored with the digital image data, along with theGPS coordinate information when a GPS camera is utilized. Therefore, auser who has taken a digital image while at the Eiffel Tower or at theamusement park, instructs processor 25 to conduct a search to retrieveimages taken by the web cam or park camera at or about the GPScoordinates and date and time the user took his image. This search canbe an Internet-wide search or can be limited to a particular web site,for example, the web site of the Eiffel Tower tourist informationdivision or the web site of the amusement park. This provides the userwith images or video that coincides with the place and time the user wasat tat location, whereby the images might actually contain images of theuser himself. These retrieved images can then be provided to the user atno cost or for a fee.

Although a GPS system is referred to throughout this disclosure, it willbe understood by one skilled in the art that other positioning systemsare equally contemplated for use herein.

While the invention has been described with reference to severalembodiments, it will be understood by those skilled in the art that theinvention is not limited to the specific forms shown and described.Thus, various changes in form and details may be made therein withoutdeparting from the spirit and scope of the invention as defined by theappended claims.

1. A system for organizing and retrieving digital images, comprising: afirst database for storing first data and digital image data; a seconddatabase for storing second data; and a processor for searching thesecond data based on the first data, and storing the second dataassociated with the first data.
 2. The system of claim 1, wherein asearch of the digital image data can be conducted based on theassociated second data.
 3. The system of claim 2, wherein the first dataincludes a date that the digital image data was originally captured, andthe second data includes at least one occasion and a date of the atleast one occasion.
 4. The system of claim 2, wherein the first dataincludes positioning system coordinates where the digital image data wasoriginally captured, and the second data includes at least one locationname and the positioning system coordinates of the at least one locationname.
 5. The system of claim 1, wherein the second database is locatedat a location remote from the first database.
 6. The system of claim 5,wherein the Internet connects the first and second databases.
 7. Asystem for organizing and retrieving digital images using globalpositioning system coordinates, comprising: a digital camera having apositioning system receiver for capturing a digital image; a firstdatabase storing the digital image data along with positioning systemcoordinates of the location where the image was taken; a second databasefor storing positioning system coordinate information and associatedlocation names of a plurality of locations; and a processor fordetermining the positioning system coordinates of the digital imagestored in the first database, searching the second database for matchingpositioning system coordinates, and if a match is found storing thelocation name with the digital image data in the first database.
 8. Thesystem of claim 7, wherein a search of the digital images is conductedon the basis of the location name.
 9. The system of claim 8, wherein atleast one of a date and a time when the image was captured is stored inthe first database with the digital image data.
 10. The system of claim9, further comprising a third database for storing at least one occasionand a date of the at least one occasion.
 11. The system of claim 10,wherein the processor determines the date of the digital image stored inthe first database, searches the third database for a matching date, andif a match is found stores the occasion with the digital image data inthe first database.
 12. The system of claim 11, wherein the locationname and occasion are used as sorting parameters for the associateddigital images.
 13. The system of claim 9, further comprising a fourthdatabase for storing second digital image data containing positioningsystem coordinate information and at least one of a data and time thesecond digital image was captured, the second digital image beingcaptured by another, wherein a search is conducted of the fourthdatabase based on at least one of the date and time stored in the firstdatabase.
 14. A method for organizing and retrieving digital imagesusing global positioning system coordinates, comprising: capturing adigital image and storing in a first database the digital image dataalong with positioning system coordinates of the location where theimage was taken; storing in a second database positioning systemcoordinate information and associated location names of a plurality oflocations; and determining the positioning system coordinates of thedigital image, searching the second database for matching positioningsystem coordinates, and if a match is found storing in the firstdatabase the location name with the digital image data.
 15. The methodof claim 14, further comprising the steps of: storing in the firstdatabase with the digital image data the date on which the image wascaptured; and storing at least one occasion and a date of the at leastone occasion.
 16. The method of claim 15, further comprising the stepsof: determining the date of the digital image stored in the firstdatabase; searching the second database for a matching date; and if amatch is found, storing in the first database the occasion with thedigital image data.
 17. The method of claim 16, further comprising thestep of storing in a third database images taken by another along withpositioning system coordinate information and at least one of a date anda time stamp.
 18. The method of claim 17, further comprising the step ofsearching the third database to retrieve images having at least one of amatching positioning system coordinates, date and time.
 19. The methodof claim 19, wherein the third database is located at a location remotefrom the first database.
 20. The method of claim 19, wherein a fee ischarged for retrieving the digital image stored in the third database.21. The method of claim 15, further comprising the steps of: determiningdigital images having dates within a first preset range and havingpositioning system coordinate information within a second preset range;and labeling the determined images with a location label and an occasionlabel corresponding to the date range and positioning system coordinateinformation range.